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(54) Low delay channel codes for correcting bursts of lost packets 



(57) A method and apparatus for coding and decod- 
ing a sequence of data packets with use of a novel class 
of forward error correcting codes having coding rates 
greater than 1/2 which nonetheless provide relatively 
high levels of channel protection against burst erasures 
with a relatively low decoding delay. In accordance with 
certain illustrative encoder embodiments of the present 
invention, the source information contained in each of a 
plurality of packets to be coded is similarly divided into 
a plurality of (similar) corresponding portions, and 
"checksums" are computed over multiple data packets, 
each such checksum being based on different (i.e., non- 
corresponding) portions of at least two of the multiple 
packets. These "checksums" are then advantageously 



appended to various subsequent data packets to be 
coded. By using different portions of multiple packets 
from which the checksums are computed, forward error 
correcting codes having rates greater than 1/2 which 
provide high levels of channel protection against burst 
erasures with relatively low decoding delays are advan- 
tageously provided. In accordance with illustrative de- 
coder embodiments of the present invention, erased da- 
ta packets may be regenerated based on the decoding 
of one or more subsequent (correctly received) data 
packets which include such appended "checksum" da- 
ta. 
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Field of the Invention 

[0001] The present invention relates generally to the field of en^or correcting codes for data transmission and more 
particularly to a packet loss recovery technique for use in data packet-based networks providing real-time multimedia 
communications. 

Background of the Invention 



[0002] One of the most significant issues that must be dealt with in data packet-based communications networks 
such as, for example, the Internet, is the problem of en-or con-ection due to packet loss. Since each data packet is 
transmitted through the network independently (and potentially via entirely different network routes), it is common for 
a destination location to fail to receive an occasional sequence of one or more data packets, and to receive some such 
15 packets after an atypically substantial delay. And when such a network is employed to provide real-time multimedia 
communications such as, for example, voice communications, receiving some data packets after a substantial delay 
may be tantamount to not receiving them at all, since the receiver cannot typically wait to ' proceed with the processing 
of subsequent data packets. 

[0003] A number of techniques, invariably involving some sort of redundancy coding, have been employed to address 
20 the general problem of error correction including the packet loss problem. Typically, the packet loss channel is recog- 
nized as an erasure channel using a channel coding language. Classical enor correcting codes such as binary block 
codes, convolutional codes, and Reed Solomon codes, each familiar to those of ordinary skill in the art, can then be 
employed in an erasure correcting mode. (See, e.g., E. Ayanoglu et aL, "Diversity Coding for Transparent Self-Healing 
and Fault-Tolerant Communication Networks," IEEE Transactions on Communications, vol. 41 , no. 11 , pp. 1677-1685, 
25 November, 1993; and R. Urbanke et aL, "Methods and Apparatus for Packetizing Data for Transmission Through an 
Erasure Broadcast Channel." co-pending U.S. Patent application. Ser. No. 08/892855, filed July 1 5, 1 997 and assigned 
to the assignee of the present invention. U.S. Patent application. Ser. No. 08/892855 is hereby incorporated by refer- 
ence as is fully set forth herein.) However, it is in fact considerably simpler to con-ect an erasure than to con-ect other 
types of errors (such as, for example, "random" modifications of one or more symbols). In the case of an error, the 
30 location of the error must first be determined, while in the case of an erasure (e.g., an unreceived data packet), the 
location is known. 

[0004] Typically, a random error correcting code can conect about twice as many erasures as errors in a given block. 
However, in the context of a transmission of a sequence of data packets across a network, a packet loss effectively 
causes a continuous string (a "bursr) of erased symbols. Since most classical channel codes are designed for the 

35 correction of random en-ors (or random erasures), prior art approaches to dealing with the packet loss problem typically 
perform some fomi of interleaving (permuting) on a relatively long sequence of packets. In this manner, a packet loss 
channel with con-elated erasures (/.e.. a continuous string of erased symbols) is transfonned into an apparently random 
erasure channel. Unfortunately, performing such an interleaving process necessarily results in a significant delay at 
the destination, since the decoder must de-interleave the received data in order to recreate the original sequence of 

40 data packets. 

[0005] Therefore, the use of channel codes such as, for example, Reed Solomon codes, when effectively applied 
across many packets in sequence, will necessarily require that relatively long delays be incurred at the receiver. As 
pointed out above, however, such delays may be prohibitive for real-time applications such as, for example, voice 
communication over networks based on the Internet protocol (IP). Recently, however, in U.S. Patent No. 5,870.412 
45 ("Fonward En-or Correction System for Packet Based Real Time Media") issued to G. M. Schuster et al. on February 
9. 1 999 (hereinafter, "Schuster et al."), a method for data recovery in a bursty packet network which incurs a relatively 
short delay (as compared to other prior art techniques) has been presented. 

[0006] Specifically, Stiuster et at. perfomis fonward enor con-ection by appending checksum infonmation to each data 
packet, wherein the checksum information is defined by taking a bit-by-bit exclusive-or sum of the infonnation portion 

50 (the "payload") from a preceding specified number of data packets. (Bit padding on the shorter payloads is used if the 
information payloads from the preceding packets are of unequal length.) By way of illustration. Fig. 1 shows an organ- 
ization of an encoded data packet in accordance with the prior art packet loss recovery techniques as employed in 
Stiusteret al. The illustrated data packet comprises coded information followed by checksum infonnation which has 
been appended to the data packet for purposes of fonward error correction. As described above, in the case of the 

55 Shuster et al. technique, the checksum infonnation specifically comprises an exclusive-or sum of the information pay- 
load from a preceding specified plural number of data packets. 

[0007] Thus, using the Shuster et al. technique, a single bit erasure con-ection code of length w+1 packet instances 
is formed, enabling for the correction of a burst of up to w lost data packets (provided such a burst is followed by a 
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string of w correctly received data packets), with a maximum decoding delay of 2iv-1 packets. Clearly, the Shuster et 
ai. method incurs an overhead in bit volume of at least 100% (more if bit padding is required), as compared to the bits 
of the information payloads alone. In addition, it can be seen that the method of Shuster et al. requires the solution of 
w exclusive-or equations. 

5 [0008] In co-pending U.S. patent application Ser. No. 09/425,143, "Packet Loss Control Method For Real-Time Mul- 
timedia Communications" by H-L. Lou and C-E. W. Sundberg, filed on October 21, 1999 and commonly assigned to 
the assignee of the present invention (hereinafter, "Lou et al"), a significantly improved technique over that of Shuster 
et al. was provided. U.S. patent application Ser. No. 09/425,143 is hereby incorporated by reference as if fully set forth 
herein. By way of illustration. Fig. 2 shows an organization of an encoded data packet in accordance with the prior art 

10 packet loss recovery techniques as employed in Lou et aL 

[0009] In particular, while Shuster et at, generates checksum information by "combining" (e.g.. by performing exclu- 
sive-or operations on) the payload information from a plurality of preceding data packets. Lou et al. simply "repeats" 
information content from a particular one of the previous data packets in a later packet. More specifically, according 
to the technique of Lou et al., the Information payload associated with a given data packet /c, for example, might be 

15 identically copied and appended to data packet k+w. (That is, the information payload would be repeated with a delay 
of w transmitted packets.) Such an improved approach advantageously can correct for a burst of up to w lost data 
packets (as does the method of Shuster et al.) while improving the decoding delay to w packets as compared to the 
2w-1 decoding delay required by the method of Shuster et aL In fact, it can be shown that the decoding delay required 
by the technique of Lou et aL, relative to the number of consecutive lost packets that can be properly corrected, is in 

20 fact optimal. (Note that each of these prior art approaches append forward error correcting data to the existing packets 
without adding any additional packets.) 

[0010] Both of the above-described prior art approaches (/. e. , those of both Shuster et al. and the improved method 
of Lou et aL), however, are limited to providing rate 1/2 convolutional forward error correcting codes (FEC). (As is fully 
familiar to those of ordinary skill In the art, the "rate" of an error correcting code is determined based on the ratio 

25 between the total number of bits used to encode a given set of data being encoded, and the number of "information" 
bits which are being encoded therefrom.) Often, however, it is desirable to employ error correcting codes with rates 
which are greater than 1/2 for purposes of increased transmission efficiency. Therefore, it would be highly desirable 
to devise forward error correcting channel coding techniques having rates greater than 1/2, which, like the rate 1/2 
technique of Lou et aL, advantageously provide relatively high levels of channel protection against burst erasures with 

30 a relatively (if not optimally) low decoding delay, while still maintaining the existing number of transmitted packets and 
the existing packet structure. 

Summary of the Invention 

35 [0011] In accordance with the principles of the present invention, a novel class of forward error correcting codes 
having coding rates greater than 1/2 are provided which provide high levels of channel protection against burst erasures 
with a relatively low decoding delay. In particular, a novel method of channel coding in accordance with certain illustrative 
embodiments of the present invention comprises similarly dividing the source Information {i.e., the data) contained in 
each packet to be coded into a plurality of (similar) corresponding portions, and then computing "checksums" over 

40 multiple data packets, each such checksum being based on different (i.e., non-corresponding) portions of at least two 
of the multiple packets. These "checksums" are then advantageously appended to various subsequent data packets 
to be coded (as in the above-described prior art techniques). However, by using different portions of multiple packets 
from which the checksums are computed, forward error correcting codes having rates greater than 1/2 which none- 
theless provide relatively high levels of channel protection against burst erasures with relatively low decoding delays 

45 are advantageously provided. In accordance with illustrative decoder embodiments of the present invention, erased 
data packets may be regenerated based on the decoding of one or more subsequent (correctly received) data packets 
which include such appended "checksum" data. 

[0012] More specifically, in accordance with the present invention, a method of coding a sequence of data packets 
representing a continuous stream of Information is provided, wherein each data packet comprises a set of payload 

50 Information representative of a segment of said stream of information corresponding thereto, each set of payload 
Information having been similarly divided into a plurality of corresponding Individual payload information portions, the 
method or apparatus comprising steps or means for coding a plurality of said data packets, said coding of each of said 
data packets comprising coding said set of payload Information comprised therein by coding at least one of said plurality 
of individual payload information portions thereof; and coding an additional one of said data packets, said additional 

55 data packet being subsequent in said sequence to each of said plurality of data packets, said plurality of data packets 
thereby being previous to said additional data packet, said coding of said additional data packet comprising coding 
said set of payload information comprised therein, said coded additional data packet further comprising an added set 
of payload information which provides forward error correcting capability for said payload information comprised in 
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said plurality of previous data packets, wherein said added set of payload information comprised in said coded additional 
data packet is based on a combination of said payload information comprised in two or more of said previous data 
packets, and wherein said payload information comprised in at least two of said previous data packets upon which 
said added set of payload infomriation is based comprises payload infonmation from different individual payload infor- 

5 mation portions thereof. 

[001 3] In addition, in accordance with the present invention, a method and apparatus for decoding a coded sequence 
of data packets in response to an erasure of one or more of said data packets in said sequence is provided, wherein 
said sequence of data packets has been coded with use of the above described coding technique, and wherein the 
method or apparatus comprises steps or means for decoding said coded additional one of said data packets, said 

10 additional one of said data packets being subsequent in said sequence to at least one of said erased data packets, to 
generate at least one of said individual payload information portions thereof representative of said fon/vard en^or cor- 
recting data; and reproducing said at least one of said erased data packets based on at least said generated individual 
payload information portion of said decoded additional one of said data packets. 

*5 Brief Description of the Drawings 

[0014] 

Fig. 1 shows an organization of a sequence of encoded data packets which have been coded in accordance with 
20 a certain first prior art packet loss recovery technique. 

Fig. 2 shows an organization of a sequence of encoded data packets which have been coded in accordance with 
a certain second prior art packet loss recovery technique. 

Fig. 3 shows an iliustrative zero state response of a code constructed in accordance with a first illustrative embod- 
iment of the present invention. 

25 Fig. 4 shows an organization of a sequence of encoded data packets which have been coded in accordance with 

a first illustrative embodiment of the present invention. 

Fig. 5 shows an organization of a sequence of encoded data packets which have been coded in accordance with 
a second illustrative embodiment of the present invention. 

Fig. 6 shows an organization of a sequence of encoded data packets which have been coded in accordance with 
30 a third illustrative embodiment of the present invention. 

Fig. 7 shows a generalized view of an organization of a sequence of encoded data packets which have been coded 
in accordance with one general class of illustrative embodiments of the present invention. 
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Detailed Description 
Notation 



[0015] For any symbol s, define as the string obtained by repeating s exactly x times {e.g., {00}2 = {0000}). We 
denote the concatenation of two strings, a and ft as a 0 6 (e.g., {01} 0 {11} = {0111}). We use e = (..., Oq, e^, eg,...) to 

40 denote an erasure sequence where e, = 1 if and only if the /"th symbol is erased. In general, for any vector e, we use 
subscripts and superscripts together to denote the sub-vector from component / to component j as in e/. = (©/, 6,+^...., 
ey_i,ey). We will use the wild character, to indicate that a particular symbol may be arbitrary (e.g., e = (1 * 1) refers 
to both (101) and (111 )). We will use the notation " 0 " to indicate that a particular symbol may be anything but 0 (e.g., 
X = (102) could be (112) or (122) but not (102)). 

45 [001 6] A sequence of erasures. e|+i , e|+2 ©i+s* "S referred to as an "erasure burst" of length s relative to a "guard 

space" of length g if: 

1 . Oj +1 = e|+s = 1 

2. The g symbols preceding ei+i and the g symbols following ei+g are all O's. 
50 3. The s symbols from e|+^ through ei+g contain no subsequence of g O's. 

[0017] We will use x[i\ to refer to information sequences and y[/] to refer to the corresponding encoded sequences. 
Let xli] denote the information sent in symbol /. In accordance with certain illustrative embodiments of the present 
invention, in order to achieve a rate k/n error correcting code, we will advantageously divide x[/] into k equal units: x 

55 [/] = (x^[i\^ X2li\ xj/]). Each unit is an element of GF(20 with addition, ©, and multiplication. ®, of units canried out 

according to the standard rules of finite field arithmetic, fully familiar to those of ordinary skill in the art. We shall use 
D to denote the delay operator. Thus an information sequence consisting of 2 non-zero symbols at time 0 and time 1 
with all other symbols being 0 may be written as: 
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i(D) = (XoIOl.x^IOl [01) + Xo[1]. (Xi[2] xJO])D 

Similarly, the coded sequence for a corresponding repetition code may be written as: 

5 

y(D) = (x[0],x[-1l + x[1], x[0])D + x[2], x(1] 

As is customary, we will use i_ aJ to denote the integer part of the real number a (for example, l 3/2j = 1 ), and we will 
10 use al to denote the next Integer greater than or equal to the real number a (for example. 3/2n = 2). 

[0018] We will use c^.cj to refer to the Hamming distance (familiar to those skilled in the art) between two 
symt)0)s Cf and C2- Specifically, c^hCc^, C2} = 0 if and only if and C2 are identical and 1 otherwise. We will use the 
same notation to refer to the Hamming distance between sequences. The Hamming distance between two sequences 
is defined as the sum of the distances between the symbols: 



15 



20 



25 



50 



d„ {c(D),c, (D)} = Y.<iH {c. [/]} 



Note that the symbol size is relevant in evaluating the distance. For example, 

cy;,{(10)+(01)(O).(01) + (11)D} = 2 
but 

30 * cf„{(1) + (0)0 + (0)0^ + (1)D^ (0) + (1)D + (1)d2 + (^)D^} = 3. 

Review of certain prior art techniques in relation to certain advantageous criteria 

[0019] There exist a large class of potential channels which qualify as burst erasure channels and various metrics 
35 rnay be appropriate to characterize the quality of a given forward error correcting code for a general channel. As one 
generally useful criteria, however, it is often advantageous to evaluate an error correcting code by measuring the 
longest erasure burst that can be corrected by the given code for a given delay and guard space. Thus, in accordance 
with the principles of the present invention, we expressly define our "goal" to be that of reliably transmitting information 
over a burst erasure channel {i.e., a channel which tends to experience multiple consecutive erasures) with a fixed 
40 (and preferably minimal) decoding delay constraint. 

[0020] Fig. 1 shows an organization of a sequence of encoded data packets which have been coded in accordance 
with the prior art packet loss recovery technique described In Shuster et al. The specific technique described therein 
Is designed to correct erasure bursts of length 3 (for example) with a rate 1/2 systematic error connecting code. Clearly, 
to use a rate 1/2 code and maintain the same Information rate, the packet payload size must be doubled. The information 
45 bits are grouped into symbols, x[/], occupying the "left" {i.e.. the first) half of the packet payload and the parity check 
bits are grouped into symbols occupying the "right" {i.e., the second) half of the packet payload. As can be seen, for 
example, from Fig. 1 . the rule to create the PXh coded packet in accordance with the technique of Siiuster et al. is: 



Yolf] = x[/] 
yi ['1 = x[/-3]©x[/-2] ®x[/-1 ] 

55 As can also be seen from the figure, if packets y[/+1], y(/+ 2], and y[/+3] are lost due to a burst of length 3. the conre- 
sponding information symbols can be recovered once y[/+4], y[/+5]. and y[/+6] are received by solving the parity check 
equations as shown below: 
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x[/+5]=yi[/+51 



x[/+4] = yi[/+4] 



x[/+3] = yi[/+6]exI/+5]ex[/+4] 



x[h2] = yi[/+5]ex[/+4]ex(/+3] 



x[/+1] = yi[/+4]ex[/+3]ex[/+2] 

IS 

Thus x[H-1l may be recovered once y[/+6] has been received, thereby resulting in a decoding delay of 5. 
[0021] Fig. 2 shows an organization of a sequence of encoded data packets which have been coded in accordance 
with the prior art packet loss recovery technique disclosed in Lou et al. In particular, Lou et al. proposes a code referred 
to as the "duplicate and delay" code. Note specifically that if packets y[H-1], y[/+2]. and y [/+3] are lost due to an erasure 
20 burst of length 3, the corresponding infonnation symbols can be recovered once y [/+4], y [/+5], and y [/+6] are received, 
since 

x[/+1]=yi[/+4],x[/+21 =yi[/+5], x[/+3] =yi[/+6]. 

25 

Note that x[/+/] is recovered from yi[/+/+31 for ; e {1 ,2,3}. Thus, the decoding delay of the technique of Lou et al. is 
advantageously only 3, as opposed to the decoding delay of 5 required for the technique disclosed in Shuster et ai 
Therefore, it can be seen that the simple duplicate and delay code is "superior" (in terms of our adopted criteria or 
"goal") to the code disclosed in Shuster et al. - whereas both codes can correct a burst of 3 erasures, the duplicate 
30 and delay code has a shorter decoding delay. 

An overview of a class of illustrative embodiments of the present invention 

[0022] In accordance with the principles of the present invention, a technique which provides for the construction of 
35 a class of systematic, linear, time-invariant, convolutional codes which are advantageously "maximally short" is de- 
scribed herein. We call these codes "maximally short" (MS) because they advantageously have the shortest possible 
decoding delay and the shortest possible guard length for a given erasure burst length. Although this technique provides 
for a class of codes having various coding rates greater than 1/2, in order to introduce some further notation and to 
illustrate certain key ideas, a pair of 2/3 rate codes in accordance with first and second illustrative embodiments of the 
40 present invention, as well as a rate 3/5 code in accordance with a third illustrative embodiment of the present invention, 
will be presented in detail herein before the general class of illustrative codes is described. 

[0023] In particular, we will describe how to advantageously construct MS codes for all rates of the form R = {ms + 
1) / {ms + 1 + s), where m and s are arbitrary positive integers. We will refer to the rate {ms + 1) / (ms + 1 + s) code 
as MS(m,s). It can be shown that these codes are advantageously capable of correcting erasure bursts of length s 
45 with a guard length (g) and a decoding delay (T) as follows: 

g= T= ms + ^. 

50 In accordance with certain illustrative embodiments of the present invention, we also disclose a simple periodic inter- 
leaving technique which corresponds to upsampling by a given factor, X. It can be shown that by interleaving in the 
proposed manner, an MS(/t7,s) code developed in accordance with the principles described herein, which is capable 
of correcting erasure bursts of length s with guard length g and decoding delay T, may be advantageously transformed 
into a related code which is capable of correcting erasure bursts of length Xs with a corresponding guard length of Xg 

55 and a decoding delay of XT. 

[0024] The illustrative construction in accordance with the present disclosure advantageously makes extensive use 
of systematic, linear, maximum distance separable (MDS) block codes. MDS codes, which are fully familiar to those 
of ordinary skill in the art, are useful building blocks because MDS codes with useful properties can be constructed as 
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Reed-Solomon codes. (Reed-Solomon codes are also fully familiar to those of ordinary skill in the art.) Specifically, it 
is well known that linear, systematic, Reed-Solomon codes can be constructed for all values of (n, ^, d = n - /c + 1) 
using Q-ary symbols over GF(q=20. 

5 A rate 2/3 code in accordance with a first illustrative embodiment 

[0025] When considering linear, time-invariant convolutional codes, a useful tool is the zero state response (ZSR), 
fully familiar to those of ordinary skill in the art, which is the output of an encoder that starts in the all 0 state. We can 
completely specify a code using the zero state response to an input which is non-zero only at time 0 (ZSRq). However. 
10 it is usually easier to analyze a code by writing out the ZSR for a stream of input symbols instead of just an input at 
time 0. For example, consider a rate 2/3 parity check code in accordance with a first illustrative embodiment of the 
present invention. Specifically, this illustrative code, which will be referred to as MS(1,1), is defined as having the 
following ZSRq: 

y(D) = (x[0],x^ [0],0) + (0. 0, Xo[0]) D + (0. 0. [0]). 

[0026] Fig. 3 shows an illustrative zero state response of a code constructed in accordance with this first illustrative 
embodiment of the present invention. In particular, the ZSR for a stream of information symbols starting at time 0 is 
20 shown in the figure. 

[0027] Fig. 4 shows an organization of a sequence of encoded data packets which have been coded in accordance 
with the first illustrative embodiment of the present invention, as specifically defined in terms of the ZSR shown in Fig. 
3. From Fig. 4 it can be seen that this illustrative MS(1 ,1) code can advantageously correct an erasure burst of length 
1 with a guard space of 2 and a decoding delay of 2. Consider, for example, the situation explicitly shown in the figure 
25 where the coded symbol y[3] is erased. To recover Xo[3] the decoder advantageously waits until 

y[4] = (Xo[4]. Xi[4], Xo[3]exi[2]) 

30 is received, and it then recovers Xo{3] using Xo[3]=y3[4]®(-Xi[2]). Similariy, x^[3] is recovered from y[5] using Xi[3]=y3 
[5] @(-Xo[4]). 

[0028] Cleariy, the decoding delay required for this first illustrative embodiment of the present invenfion is T = 2 , 
The guard space required is g = 2 because the decoding "rule" only requires that the 2 symbols after the erasure and 
the 1 symbol preceding the erasure are unerased. Note that it can easily be shown that the illustrative MS(1,1) code 
35 Is advantageously "optimal" in terms of these adopted criteria. 

An interleaved rate 2/3 code in accordance with a second Illustrative embodiment 

[0029] Admittedly, a code which corrects only 1 erasure does not meet the intuitive meaning of a "burst erasure" 
40 correction code. However, by using degree X periodic interieaving, an s erasure burst correcting code having guard 
length and decoding length grand T, respectively, and derived in accordance with the principles of the present invention, 
may be advantageously transformed into a Xs erasure burst correcting code having guard length and decoding delay 
Xg and XT, respectively. Specifically, such an interieaving process, which may be advantageously used in accordance 
with a second illustrative embodiment of the present invention, is simply upsampfing. In particular, given a code with 
45 ZSRq y(0), the ^-upsampled "version" of the given code has ZSRq y{0^). 

[0030] Fig. 5 shows an organization of a sequence of encoded data packets which have been coded in accordance 
with a second illustrative embodiment of the present invention in which the MS(1 ,1 ) code (i.e., the rate 2/3 code of the 
first illustrative embodiment of the present invention) has been upsampled by = 2 to obtain ZSRq 

^ y{0^) = (Xo[0]. xi[0], 0) (0. 0 x^lO])D^. 

[0031] Note that in accordance with this second illustrative embodiment of the present invention, if a burst of 2 
erasures starts at, for example, time t - 4, then the erased symbols can be recovered in a manner similar to that 
55 described above in connection with the first illustrative embodiment of the present invention (i.e., the non-upsampled 
rate 2/3 code). Note also that the decoding delay and guard length required for the upsampled code are clearly twice 
that required for the "base" code. Thus, the upsampled code in accordance with the second illustrative embodiment 
is a rate 2/3 code with gis = TIs ~ 4/2 = 2, which is also advantageously "optimal" in terms of the adopted criteria. 
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[0032] It will be obvious to those of ordinary skill in the art that, in general, MS(m,1 ) codes of rate R = {m+^ )/{m+2} 
can be advantageously constructed in accordance with the principles of the present invention for any value of m ^ 1 
using single parity check codes similar to the one described above in the discussion of the first illustrative embodiment 
of the present invention (i.e., the rate 2/3 code). It will also be obvious to those skilled in the art that these codes will 
5 have decoding delay T - /n+1, and will require a guard space of g = Such codes advantageously meet the 
"optimality" criteria discussed above and adopted herein. Moreover, and also in accordance with the principles of the 
present invention, these codes may be advantageously upsampled by any multiple X. = s In order to produce codes 
which correct erasure bursts of length s for any s > 1 , Cleariy. these codes also advantageously meet the "optimality" 
criteria discussed above and adopted herein. 

10 

A rate 3/5 code in accordance with a third illustrative embodiment 

[0033] Note that the MS(1 ,1 ) code as defined above in accordance with the first illustrative embodiment of the present 
invention is based upon a (3,2) single parity check (SPC) block code, which is fully familiar to those of ordinary skill in 

15 the art. Note also, however, with reference for example to Fig. 4, that the parity check symbols are not computed on 
"rows" or "columns." of symbols, but rather, are advantageously computed on "diagonals" of symbols. To generalize 
the MS(1 ,1 ) code to coding rates other than 2/3 in such a way so as to maintain its desirable perfomriance characteristics, 
we advantageously maintain the idea of using block codes computed across packets, but move to using maximum 
distance separable (MDS) block codes (also fully familiar to those of ordinary skill in the art) instead of using SPC block 

20 codes. Specifically, let C be a systematic, {n, k,d) = (6,4.3) block code. (Note that it will be fully familiar to those skilled 
in the art that a (6,4,3) MDS code can be constmcted by first constructing an (8,4,5) systematic Reed-Solomon code 
over GF(23) and then puncturing the last two parity check symbols.) We denote the 2 parity check symbols of C cor- 
responding to the 4 information symbols (xo,x>t,X2,X3) as P{xo,Xi,X2.X3}. 

[0034] The ZSRq for the rate 3/5. MS(1,2) code in accordance with a third illustrative embodiment of the present 
25 invention is 

y(D) =(Xo[0]. XiEO], X2[0].0.0)+ 
30 (O.O.O.P{Xo[OLXo[1]0.0})d2 + 

(0, 0, 0, P {0, 0. x^[Ol X2[0]})D^ 

[0035] Fig. 6 shows an organization of a sequence of encoded data packets which have been coded in accordance 
35 with a third illustrative embodiment of the present invention, based on this illustrative MS(1 ,2) code and on the above 
ZSRq. The figure also shows an illustrative process of decoding a given erasure burst of length 2. As can be seen in 
the figure, the illustrated erasure burst erases the coded symbols y[3] and y[4]. In accordance with the principles of 
the present invention, the decoder advantageously waits until y[5] is received, and then uses the decoding algorithm 
for C to recover Xq[3] and Xo[4] from y^^S] = P{xq[4], XqIS], Xi[2], X2[2]). Since C has minimum distance 3 and * (illus- 
40 tratively) we have assumed herein that neither x^[2] nor X2[2] were erased, Xo[3] and Xo[4] can be successfully recov- 
ered. Next, the decoder receives y[61, and then advantageously uses it to decode x^ 2(3] from yj 4 [6] = P{xo[5), Xo[4], 
Xi[3], X2[3]}. Since Xo[4] was recovered at the previous step and since Xo[5] was unerased, x^ 2[^] can be successfully 
recovered. Finally, when the decoder receives y3 4 [7] = P{xo[6], Xo[5], x^[A], X2[4]}, it can advantageously recover 2 
[4], since Xo[5] and Xo[61 were also (illustratively) unerased. 
45 [0036] By inspecting Fig. 6 it can be easily seen that for an erasure burst of length 2 starting at time t, the illustrative 
decoding rule as described herein requires that symbols t+2, f+3. and M be unerased. Therefore the guard space 
required is cleariy g = 2. Similariy, it can be seen that the decoding delay will also be T = 2. These values meet the 
"optimality" criteria as described above (and therefore the illustrative MS(1 ,2) code as described is, in fact, "maximally 
short"). 

50 [0037] In accordance with another Illustrative embodiment of the present invention, the MS(1 ,2) code can be advan- 
tageously upsampled in an analogous manner to the upsampling of the MS(1,1) performed in accordance with the 
second illustrative embodiment of the present invention. In particular, the MS(1 ,2) may be upsampled by X to obtain a 
rate 3/5 code which corrects erasure bursts of length sX relative to a guard space of gX and with a decoding delay of 
TK. (Note that again, since the "base" code is maximally short, the upsampled codes will also advantageously be 

55 maximally short.) 
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A generalized class of Illustrative embodiments of the present invention 

[0038] Fig. 7 shows a generalized view of an organization of a sequence of encoded data packets which have been 
coded in accordance with one general class of illustrative embodiments of the present invention. In particular, a tech- 
nique for constructing general MS(m,s) codes for all m > 1 and all s > 1 in accordance with the principles of the present 
invention is described below. Based on such a construction, a class of illustrative encoder and decoder embodiments 
of the present invention may be advantageously derived. It is to be noted that, like the MS(1,1) and MS(1,2) codes 
described above, these generalized MS(m,s) codes (as well as all upsampled "versions" thereoO are all "maximally 
short" and thereby "optimal" in terms of the above-identified and adopted criteria. In particular, all of the MS(m,s) codes 
constructed by this illustrative procedure have rate R = (ms^-l )f^ms+^ +s), and they can advantageously correct erasure 
bursts of length s relative to a guard space of g = ms + 1 with a decoding delay of T = /ns + 1 . 
[0039] Specifically, to construct an illustrative fsAS{m, s) code in accordance with the principles of the present invention, 
we first construct a systematic, MDS, block code, C, with parameters {n, k, d) = {2s+/f-1, k+s-^ , s+1). Note that C can 
always be advantageously constructed by choosing r = log2{2s + k - ^}l and puncturing a systematic (2'', + s - 1, 
2'- /f - s + 2) Reed-Solomon code over GF(20. It is well known to those of ordinary skill in the art that Reed-Solomon 
codes over GF(20 can be constructed for all (n < 2^ /c < a n - /c + 1 ). Groups of r bits may be mapped to individual 
symbols for this code. If the packet size is not a multiple of r bits, some padding may be advantageously added at the 
end of the packet. 

[0040] Now let P{xo,Xi be the n - /f = s parity check symbols for C. Then, the ZSRq for the MS{m,s) code is: 

sO's 



>;(D) = (xr[0],0,0,.... 0) 



kQ*s iO's k+s-2-iO's 



+ 2(0,0...., 0, i>{0,0,..., 0, x„[0],0,0,..., 0}£)'*' 

1=0 

kO's (i+I)jO*j Jt-a-5-IO'* 

+ g (0,0,..., 6. P{'o,o..'... d. 4T-'[o], b,o..".., 6})Z)"*'>"' 



Given the ZSRq shown above, it will be obvious to those of ordinary skill in the art that a general class of MS(m,s) 
codes can be derived in accordance with the principles of the present invention. Illustrative encoder and decoder 
embodiments of the present invention may then be easily derived therefrom. By examining the above ZSRq and the 
illustrative encoding as shown in Fig. 7. it can specifically be seen that the coded symbol at time / is: 



y{i] = x^[i], P{x^[i-l], x^[i-2],..., x„[i~s], 
xl[i-s-l], ,<*,[i-25-l], .... 



[0041] Note that, in particular, the MS(0,s) codes as defined in the above manner, are rate 1/(s+1 ) repetition codes, 
such as is the delay and duplicate code disclosed in Lou etai. (which is, in particular, a 1/2 repetition code). In general, 
MS codes for rates less than or equal to 1/2 are repetition codes, whereas, in accordance with various illustrative 
embodiments of the present invention, MS codes for rates greater than 1/2 advantageously involve the computation 
of an appropriate "checksum." Consequently, MS codes generally, can in some sense be viewed as a "generalization" 
of delay and duplicate codes. Note, for example, that the illustrative rate MS(m,1) codes are rate {m+^)/{m+2) single 
parity check convolutional codes where the parity check is computed over diagonals such as in the illustrative 2/3 rate 
code described above and shown in Fig. 4. 

Addendum to the detailed description 

[0042] It should be noted that all of the preceding discussion merely illustrates the general principles of the invention. 
It will be appreciated that those skilled in the art will be able to devise various other arrangements which, although not 
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explicitly described or shown herein, embody the principles of the invention and are Included within its spirit and scope. 
Furthermore, all examples and conditional language recited herein are principally intended expressly to be only for 
pedagogical purposes to aid the reader In understanding the principles of the invention and the concepts contributed 
by the inventors to furthering the art, and are to be construed as being without limitation to such specifically recited 

5 examples and conditions. Moreover, all statements herein reciting principles, aspects, and embodiments of the inven- 
tion, as well as specific examples thereof, are intended to encompass both stmctural and functional equivalents thereof. 
Additionally, it is intended that such equivalents include both cun-ently known equivalents as well as equivalents de- 
veloped in the future - i.e., any elements developed that perform the same function, regardless of structure. 
[0043] Thus, for example, it will be appreciated by those skilled in the art that the block diagrams herein represent 

10 conceptual views of illustrative circuitry embodying the principles of the invention. Similariy, it will be appreciated that 
any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which 
may be substantially represented in computer readable medium and so executed by a computer or processor, whether 
or not such computer or processor is explicitly shown. 

[0044] The functions of the various elements shown in the figures, including functional blocks labeled as "processors" 

15 or "modules" may be provided through the use of dedicated hardware as well as hardware capable of executing software 
in association with appropriate software. When provided by a processor, the functions may be provided by a single 
dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be 
shared. Moreover, explicit use of the temi "processor" or "controller" should not be construed to refer exclusively to 
hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) 

20 hardware, read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. 
Other hardware, conventional and/or custom, may also be included. Similariy, any switches shown in the Figs, are 
conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, 
through the interaction of program control and dedicated logic, or even manually, the particular technique being se- 
lectable by the implementer as more specifically understood from the context. 

25 [0045] In the claims hereof any element expressed as a means for performing a specified function is intended to 
encompass any way of performing that function including, for example, (a) a combination of circuit elements which 
performs that function or (b) software in any forni, including, therefore, fimiware. microcode or the like, combined with 
appropriate circuitry for executing that software to perform the function. The invention as defined by such claims resides 
in the fact that the functionalities provided by the various recited means are combined and brought together in the 

30 manner which the claims call for. Applicant thus regards any means which can provide those functionalities as equiv- 
alent (within the meaning of that term as used in 35 U.S.C. 112, paragraph 6) to those explicitly shown and described 
herein. 



35 Claims 

1 . A method of coding a sequence of data packets representing a continuous stream of information , each data packet 
comprising a set of payload information representative of a segment of said stream of information corresponding 
thereto, each set of payload information having been similariy divided into a plurality of corresponding individual 

40 payload information portions, the method comprising the steps of: 

coding a plurality of said data packets, said coding of each of said data packets comprising coding said set of 
payload information comprised therein by coding at least one of said plurality of individual payload information 
portions thereof; and 

45 coding an additional one of said data packets, said additional data packet being subsequent in said sequence 

to each of said plurality of data packets, said plurality of data packets thereby being previous to said additional 
data packet, said coding of said additional data packet comprising coding said set of payload information 
comprised therein, said coded additional data packet further comprising an added set of payload infonmation 
which provides fonward error connecting capability for said payload information comprised in said plurality of 

50 previous data packets, 

wherein said added set of payload information comprised in said coded additional data packet is based on 
a combination of said payload information comprised in two or more of said previous data packets, and wherein 
said payload information comprised in at least two of said previous data packets upon which said added set of 
55 payload information is based comprises payload infonnation from different individual payload information portions 

thereof. 

2. The method of claim 1 wherein said sets of payload information comprised in each data packet to be coded have 
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been similarly divided into m con^esponding individual payload infomiation portions where m is an integer greater 
than one, and wherein said added set of payload information comprised in said coded additional data packet 
comprises a checksum of /n different individual payload infomnation portions of m of said plurality of data packets, 
said checksum based upon a single parity check block code, thereby resulting in a rate m/(m+^) forward error 
correcting code. 

The method of claim 2 wherein m is equal to 2 and wherein said added set of payload information comprised in 
said coded additional data packet comprises a checksum of a first individual payload information portion of a first 
one of said plurality of data packets and a second individual payload information portion of a second one of said 
plurality of data packets, thereby resulting in a rate 2/3 forward error correcting code. 

The method of claim 1 wherein said sets of payload information comprised in each data packet to be coded have 
been similariy divided into m corresponding individual payload information portions where m is an integer greater 
than one, and wherein said added set of payload information comprised in said coded additional data packet 
comprises a checksum based upon a maximum distance separable block code. 

The method of claim 1 wherein said added set of payload information comprised in said additional one of said data 
packets is interleaved with one or more other added sets of payload information which are based on data packets 
other than said two or more of said previous data packets. 

A method of decoding a coded sequence of data packets in response to an erasure of one or more of said data 
packets in said sequence, said sequence of data packets representing a continuous stream of information and 
including coded forward error correcting data therefor, each coded data packet comprising a set of payload infor- 
mation similariy divided into a plurality of corresponding individual payload information portions thereof, two or 
more of said individual payload information portions of each data packet representative of a corresponding segment 
of said stream of information and another one or more of said individual payload portions of each data packet- 
representative of said forward error correcting data, the coded sequence of data packets having been coded by [ 

(a) coding a plurality of said data packets, said coding of each of said data packets comprising coding said 
set of payload information comprised therein by coding at least one of said plurality of individual payload 
information portions thereof, and 

(b) coding an additional one of said data packets, said additional data packet being subsequent in said se- 
quence to each of said plurality of data packets, said plurality of data packets thereby being previous to said 
additional data packet, said coding of said additional data packet comprising coding said set of payload infor- 
mation comprised therein, said coded additional data packet further comprising an added set of payload in- 
formation representative of said forward error correcting data capability for said payload information comprised 
in said plurality of previous data packets, 

wherein said added set of payload information comprised in said coded additional data packet is based on 
a combination of said payload information comprised in two or more of said previous data packets, and wherein 
said payload information comprised in at least two of said previous data packets upon which said added set of 
payload information is based comprises payload information from different individual payload information portions 
thereof, 

the method of decoding comprising the steps of: 

decoding said coded additional one of said data packets, said additional one of said data packets being sut>- 
sequent in said sequence to at least one of said erased data packets, to generate at least one of said individual 
payload information portions thereof representative of said forward enror correcting data; and 
reproducing said at least one of said erased data packets based on at least said generated individual payload 
information portion of said decoded additional one of said data packets. 

The method of claim 6 wherein said sets of payload information comprised in each coded data packet have been 
similariy divided into m corresponding individual payload information portions where m is an integer greater than 
one. and wherein said added set of payload information comprised in said coded additional data packet comprises 
a checksum of m different individual payload information portions of m of said plurality of data packets, said check- 
sum based upon a single parity check block code, thereby resulting in a rate m/{m+^ ) forward error correcting code. 

The method of claim 7 wherein m is equal to 2 and wherein said added set of payload information comprised in 
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said coded additional data packet comprises a checksum of a first individual payload information portion of a first 
one of said plurality of data packets and a second individual payload information portion of a second one of said 
plurality of data packets, thereby resulting in a rate 2/3 fonvard error correcting code. 

5 9. The method of claim 6 wherein said sets of payload infomiation comprised in each coded data packet have been 
similarly divided into m con-esponding individual payload information portions where m is an integer greater than 
one, and wherein said added set of payload infonmation comprised in said coded additional data packet comprises 
a checksum based upon a maximum distance separable block code. 

10 10. The method of claim 6 wherein said added set of payload infomiation comprised in said additional one of said data 
packets has been interleaved with one or more other added sets of payload information which are based on data 
packets other than said two or more of said previous data packets. 

11, An apparatus for coding a sequence of data packets representing a continuous stream of information, each data 
15 packet comprising a set of payload information representative of a segment of said stream of information corre- 
sponding thereto, each set of payload information having been similariy divided into a plurality of con-esponding 
individual payload information portions, the apparatus comprising: 

a coder which codes each of a plurality of said data packets by coding said set of payload information comprised 
20 therein by coding at least one of said plurality of individual payload information portions thereof; and 

a coder which codes an additional one of said data packets, said additional data packet being subsequent in 
said sequence to each of said plurality of data packets, said plurality of data packets thereby being previous 
to said additional data packet, by coding said set of payload information comprised therein, said coded addi- 
tional data packet further comprising an added set of payload information which provides forward error cor- 
25 recting capability for said payload information comprised in said plurality of previous data packets, 

wherein said added set of payload information comprised in said coded additional data packet is based on 
a combination of said payload information comprised in two or more of said previous data packets, and wherein 
said payload information comprised in at least two of said previous data packets upon which said added set of 
30 payload information is based comprises payload information from different individual payload information portions 

thereof. 

12. The apparatus of claim 11 wherein said sets of payload information comprised in each data packet to be coded 
have been similariy divided into m conresponding individual payload information portions where m is an integer 

35 greater than one. and wherein said added set of payload information comprised in said coded additional data 

packet comprises a checksum of m different individual payload information portions of m of said plurality of data 
packets, said checksum based upon a single parity check block code, thereby resulting in a rate m/(m+1 ) fonward 
error correcting code. 

40 13. The apparatus of claim 12 wherein m is equal to 2 and wherein said added set of payload information comprised 
in said coded additional data packet comprises a checksum of a first individual payload information portion of a 
first one of said plurality of data packets and a second individual payload information portion of a second one of 
said plurality of data packets, thereby resulting in a rate 2/3 forward error correcting code. 

45 14. The apparatus of claim 11 wherein said sets of payload information comprised in each data packet to be coded 
have been similarly divided into m corresponding individual payload information portions where m is an integer 
greater than one, and wherein said added set of payload infomiation comprised in said coded additional data 
packet comprises a checksum based upon a maximum distance separable block code. 

50 15. The apparatus of claim 11 wherein said added set of payload infonnation comprised in said additional one of said 
data packets is interieaved with one or more other added sets of payload information which are based on data 
packets other than said two or more of said previous data packets. 

16. An apparatus for decoding a coded sequence of data packets in response to an erasure of one or more of said 
55 data packets in said sequence, said sequence of data packets representing a continuous stream of information 

and including coded forward en^or correcting data therefor, each coded data packet comprising a set of payload 
information similarly divided into a plurality of corresponding individual payload infonnation portions thereof, two 
or more of said individual payload information portions of each data packet representative of a con-esponding 
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segment of said stream of infomiation and another one or more of said individual payload portions of each data 
packet representative of said forward error correcting data, the coded sequence of data packets having been coded 
by an apparatus comprising 

5 (a) a coder which coded each of a plurality of said data packets by coding said set of payload information 

comprised therein by coding at least one of said plurality of individual payload information portions thereof, and 
(b) a coder which coded an additional one of said data packets, said additional data packet being subsequent 
in said sequence to each of said plurality of data packets, said plurality of data packets thereby being previous 
to said additional data packet, by coding said set of payload information comprised therein, said coded addi- 

10 tional data packet further comprising an added set of payload information representative of said fonvard error 

correcting data capability for said payload information comprised in said plurality of previous data packets, 

wherein said added set of payload information comprised in said coded additional data packet is based on 
a combination of said payload information comprised in two or more of said previous data packets, and wherein 
15 said payload information comprised in at least two of said previous data packets upon which said added set of 

payload information is based comprises payload information from different individual payload information portions 
thereof. 

the apparatus for decoding comprising a decoder which decodes said coded additional one of said data 
packets, said additional one of said data packets being subsequent in said sequence to at least one of said erased 
20 data packets, to generate at least one of said individual payload information portions thereof representative of said 

forward error correcting data, and which reproduces said at least one of said erased data packets based on at 
least said generated individual payload infomiation portion of said decoded additional one of said data packets. 

17. The apparatus of claim 16 wherein said sets of payload information comprised in each coded data packet have 
25 been similariy divided into m corresponding individual payload information portions where m is an integer greater 

than one, and wherein said added set of payload information comprised in said coded additional data packet 
comprises a checksum of m different individual payload information portions of m of said plurality of data packets, 
said checksum based upon a single parity check block code, thereby resulting in a rate mf{m+^) fonvard error 
correcting code. 

30 

18. The apparatus of claim 17 wherein m is equal to 2 and wherein said added set of payload information comprised 
in said coded additional data packet comprises a checksum of a first individual payload information portion of a 
first one of said plurality of data packets and a second individual payload information portion of a second one of 
said plurality of data packets, thereby resulting in a rate 2/3 forward error correcting code. 

35 

19. The apparatus of claim 16 wherein said sets of payload information comprised in each coded data packet have 
been similarly divided Into m corresponding individual payload information portions where m is an integer greater 
than one. and wherein said added set of payload information comprised in said coded additional data packet 
comprises a checksum based upon a maximum distance separable block code. 

40 

20. The apparatus of claim 16 wherein said added set of payload information comprised in said additional one of said 
data packets has been interleaved with one or more other added sets of payload information which are based on 
data packets other than said two or more of said previous data packets. 

45 



50 
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FIG. 1 
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FIG. 3 
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FIG. 7 
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